Method for ensuring synchronous presentation of additional data with audio data

ABSTRACT

A recording medium, method and apparatus for managing data are discussed. According to an embodiment, the present invention provides a method of reproducing main data and additional data. The method includes receiving the additional data associated with the main data, the additional data being divided into a plurality of segment units; and reproducing the additional data in a synchronous manner with the main data using time information if indication information indicates a presence of the time information. The time information indicates a presentation time of the additional data with respect to the main data. The main data and the additional data are reproduced according to management data, the management data including link information for linking the main data and the additional data.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.11/924,656, filed on Oct. 26, 2007, now pending, which is a continuationof U.S. application Ser. No. 11/593,082, filed on Nov. 6, 2006, now U.S.Pat. No. 7,293,189, which is a continuation of U.S. application Ser. No.10/305,020, filed on Nov. 27, 2002, now U.S. Pat. No. 7,181,636, whichclaims the benefit of a foreign priority application filed in KOREA onNov. 27, 2001, as Ser. No. 10-2001-0074382. This application claimspriority to all of these applications, and all of these applications areincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a method of recording additional datasuch as lyric and user input data to be in synchronization with audiodata on a rewritable recording medium, and of reproducing themsynchronously therefrom.

2. Description of the Related Art

A disk-type recording medium such as a Compact Disk (CD) can storehigh-quality digital audio data permanently, so that it is very popularrecording medium in these days.

Recently, a Digital Versatile Disk (called ‘DVD’ hereinafter) has beendeveloped as a new disk-type recording medium. A DVD can store much moredata than a CD, that is, high-quality moving pictures or audio data arerecorded on a DVD for much longer time. Therefore, a DVD will be usedwidely in the near future.

There are three types of DVDs—DVD-ROM for read-only, DVD-R forwrite-once, and DVD-RAM or DVD-RW for rewritable. For a rewritable DVD,the standardization of data writing format is in progress.

FIG. 1 is a block diagram of an optical disk device thatrecords/reproduces audio data to/from a recording medium.

The disk device configured as FIG. 1 comprises an optical pickup 11reading signals recorded on a rewritable DVD 10 such as a DVD-RW andwriting data streams processed into writable signals onto the rewritableDVD 10; a reproduced signal processor 12 restoring the read signals intocompressed digital data; a decoder 13 decoding the compressed digitaldata to original data; a sampler 18 digitizing an inputted analog signalat a preset sampling rate; an encoder 17 encoding the digitized LPCMdata into MPEG-, or AC3-formatted data; a writing processor 16converting the encoded data from the encoder 17 or LPCM data from thesampler 18 into signals suitable to be written; a controller 14controlling all elements to conduct user's commands such as playback orrecord; and a memory 15 for storing data temporally.

If an analog signal is applied to the disk device of FIG. 1, the sampler18 samples the analog signal at the preset sampling rate. Each sampledsignal, which is LPCM data, is applied to the encoder 17 that encodes ablock of sampled data into compressed data of pre-specified format, forexample, MPEG format. The compressed data are then applied to thewriting processor 16.

The writing processor 16 converts a series of the compressed data intobinary signals which are written in mark/space patterns on the writableDVD 10. Already-compressed digital data from outside are directlyprocessed by the writing processor 16 to be written onto the writableDVD 10.

After recording of audio data, navigation data for the audio data arecreated and then recorded on the writable DVD 10.

FIG. 2 shows the structure of RTR_AMG (Real Time Record AudioManaGement) recorded as navigation data on a rewritable disk. TheRTR_AMG includes RTR_AMGI (RTR Audio Manager General Information),AUDFIT (AUDio File Information Table), ASVFIT (Audio Still Video FileInformation Table), ORG_PGCI (ORGiginal PGC (ProGram Chain)Information), UD_PGCIT (User Defined PGC Information Table), TXTDT_MG(TeXT DaTa ManaGer), and MNFIT (MaNufacturer's Information Table).

The TXTDT_MG can include additional data of recorded songs such aslyrics. Therefore, when the controller 14 selects and reproduces arecorded song from the rewritable disk 10, it is able to present lyrictext in characters on a screen by reading it from the TXTDT_MG.

Consequently, when a user selects a recorded song to play back from therewritable DVD 10, he or she is able to view its lyric on a screen.

However, each of additional data such as a lyric included in theTXTDT_MG is linked with a recorded song wholly. In other words, a lyricin the TXTDT_MG cannot have information to synchronize in detail with arecorded song. Therefore, it is impossible to display lyric data step bystep at the same speed that the recorded song is reproduced from arewritable DVD.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a synchronizingmethod that records additional data such as lyric data and user inputdata to be synchronized minutely with audio data on a rewritablerecording medium.

It is another object of the present invention to provide a synchronizingmethod that reproduces synchronously audio data and additional datathereof that have been recorded with minutely-synchronizing information.

It is another object of the present invention to provide a method andapparatus for providing data structures that allow a synchronousreproduction of main data and additional data, which address thelimitations and disadvantages associated with the related art.

An audio data related information recording method in accordance with anaspect of the present invention segments additional information relatedwith audio data recorded on a rewritable recording medium, records theinformation segments, and further records synchronizing information,e.g., time length to keep up presentation of each information segment orstart time to present each information segment, in the vicinity of saideach information segment in order to present each information segment insynchronization with a corresponding part of the recorded audio data.

An audio data related information reproducing method in accordance withan aspect of the present invention reads sequentially a plurality ofinformation segments constituting a piece of additional informationrelated with audio data recorded on a rewritable recording medium, andmakes presentation of each information segment based on synchronizinginformation, e.g., time length to keep up presentation of eachinformation segment or start time to present each information segment,recorded in association with each information segment in order topresent each information segment in synchronization with a correspondingpart of the recorded audio data.

According to an aspect of the present invention, there is provided amethod of reproducing main data and additional data, the methodcomprising: receiving the additional data associated with the main data,the additional data being divided into a plurality of segment units; andreproducing the additional data in a synchronous manner with the maindata using time information if indication information indicates apresence of the time information, wherein the time information indicatesa presentation time of the additional data with respect to the maindata, and wherein the main data and the additional data are reproducedaccording to management data, the management data including linkinformation for linking the main data and the additional data.

According to another aspect of the present invention, there is provideda method of reproducing main data and additional data, the methodcomprising: providing the additional data associated with the main data,the additional data being divided into a plurality of segment units; andreproducing the additional data in a synchronous manner to the main datausing time information if indication information indicates a presence ofthe time information, wherein the time information is present only ifthe indication information indicates that the time information ispresent, wherein the main data and the additional data are reproducedaccording to link information for linking the main data and theadditional data, and wherein the link information is separated storedfrom the main data and the additional data.

According to another aspect of the present invention, there is provideda method of providing additional data to be reproduced with main data,the method comprising: providing the additional data associated with themain data, the additional data being divided into a plurality of segmentunits and capable of being reproduced with the main data in asynchronous manner; and providing management data associated with theadditional data, wherein the management information includes linkinformation for linking the main data and the additional data, timeinformation for reproducing the additional data with the main data inthe synchronous manner, and attribute information for providing at leastone attribute of the additional data.

According to another aspect of the present invention, there is provideda method of providing additional data to be reproduced with main data,the method comprising: providing the additional data associated with themain data, the additional data being divided into a plurality of segmentunits and capable of being reproduced with the main data in asynchronous manner; and providing management data associated with theadditional data, wherein the management information includes timeinformation and indication information indicating a presence of the timeinformation, the time information being present only if the indicatinginformation indicates the time information is present, wherein themanagement information further includes linking information for linkingthe main data and the additional data, and wherein the additional datais provided separately from the main data.

These and other objects of the present application will become morereadily apparent from the detailed description given hereinafter.However, it should be understood that the detailed description andspecific examples, while indicating preferred embodiments of theinvention, are given by way of illustration only, since various changesand modifications within the spirit and scope of the invention willbecome apparent to those skilled in the art from this detaileddescription.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention, illustrate the preferred embodiments ofthe invention, and together with the description, serve to explain theprinciples of the present invention.

In the drawings:

FIG. 1 is a block diagram of an optical disk device thatrecords/reproduces audio data to/from a recording medium according to arelated art;

FIG. 2 shows the structure of RTR_AMG (Real Time Record AudioManaGement) recorded as navigation data on a rewritable disk accordingto a related art;

FIG. 3 shows an RTR_AMG in which TXTDT_MG (TeXT DaTa ManaGer) structuredaccording to an embodiment of the present invention;

FIG. 4 shows CI (Cell Information) structured according to an embodimentof the present invention;

FIG. 5 illustrates an example of a continuous and synchronous display ofa series of lyric segments together with reproduced audio data audioaccording to an embodiment of the present invention;

FIG. 6 shows an RTR_AMG structured according to another embodiment ofthe present invention; and

FIG. 7 shows ALFIT (Audio Lyric File Information Table) structuredaccording to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In order that the invention may be fully understood, preferredembodiments thereof will now be described with reference to theaccompanying drawings.

In an audio data recording method in accordance with an embodiment ofthe present invention, lyric or user data related with a song recordedon a rewritable disk such as DVD-RW is segmented into several units.Each segmented unit is linked with each corresponding part of therecorded song through segment synchronizing information for the purposeof minute synchronization of song and additional data.

FIG. 3 shows an RTR_AMG in which TXTDT_MG structured according to anembodiment of the present invention is included.

As shown in FIG. 3, RTR_AMG is composed of RTR_AMGI, AUDFIT, ASVFIT,ORG_PGCI, UD_PGCIT, TXTDT_MG, and MNFIT. The TXTDT_MG in FIG. 3 iscomposed of respective ALUI (Audio Lyric Unit Information) searchpointers and corresponding pieces of ALUI. Each ALUI includes lyricsegments ‘SG_L_TXT #i’, which is segmented lyric text, and theirindividual output-time related information ‘Time #i’.

The output-time related information ‘Time #i’ is time-length, which acorresponding lyric segment is kept displayed for, or instant time whena corresponding lyric segment starts to be displayed. The lyric text maybe displayed as subtitles. This time information is also used todifferentiate a linked lyric segment from several lyric segmentsdisplayed altogether by different color or font for a specifiedduration.

Each lyric segment includes an ID code ‘IDCD’ as shown in FIG. 3. The IDcode is used to indicate that each segmented unit has output-timerelated information, that each segmented unit includes lyric or userdata, or that the output-time related information is duration or starttime.

Each group of segmented units is linked with a recorded song througheach ALUI search pointer in TXTDT_MG as shown in FIG. 3. For example, anALUI search pointer linked with a recorded song points a start positionof the first lyric segment of an associated segment group.

To link a recorded song with an ALUI search pointer, a piece of CI (CellInformation) related with an AOB (Audio OBject), which corresponds to asingle recorded song in general, is structured in the ORG_PGCI as shownin FIG. 4.

Each CI includes an AOBI_SRPN (AOB Information SeaRch Pointer Number)for indexing information location of a related AOB (or song), anASVUI_SRNP (ASVU (Audio Still Video Unit) Information SeaRch PointerNumber) for indexing information location of still video data linkedwith an AOB, and an ALUI search pointer number ‘ALUI_SRPN’ for indexingan ALUI search pointer in the TXTDT_MG that points a segment groupcontaining a full lyric text related with an AOB.

Thus, if a song, namely, an AOB is chosen, the controller 14 reads thenumber written in ALUI_SPRN of CI associated with the selected AOB, andreads an address in ALUI search pointer indexed by the read number inthe TXTDT_MG. The location of lyric text related with the selected songis found by this read address.

Then, lyric segments are retrieved sequentially from the addressedlocation by the reproduced signal processor 12. At this time, thecontroller 14 examines an ID code preceding each lyric segment. If theID code is indicative of type of output-time related information, e.g.,a time length for which the following lyric segment ‘SG_L_TXT #i’ isdisplayed, the controller 14 keeps outputting each lyric segment for aduration specified by the time length and changes current lyric segmentwith the next one after the time length expires. This operationcontinues until the end of AOB or stop request is received.

FIG. 5 illustrates continuous and synchronous display of a series oflyric segments together with reproduced audio data belonging to theselected AOB.

Referring to FIG. 5, if the ID code is indicative of presentation starttime of each lyric segment, the controller 14 outputs each lyric segmentthe moment an elapsed time after reproducing the chosen AOB (or song)becomes equal to the start time specified by field ‘Time’. Thecurrently-outputted lyric segment keeps being outputted until the nextsegment is outputted at its start time.

If the ID code is indicative of not the type of output-time relatedinformation but the type of additional information, e.g., user data, thecontroller 14 processes the segmented additional information adequatelyfor the designated type.

If the ID code indicates that there is no output-time relatedinformation in lyric segments, then the lyric segments are sequentiallyread out irrespective of time. This operation seems to correspond to aconventional lyric data displaying method.

The lyric segments related with a recorded song may be written in a fileother than the RTR_AMG, instead of the TXTDT_MG FIG. 6 shows an RTR_AMGstructure according to another embodiment of the present invention. TheRTR_AMG of FIG. 6 includes an ALFIT (Audio Lyric File Information Table)for storing in another file the lyric data that are composed ofsegmented information such as lyrics or user data of all recorded songs.

FIG. 7 shows the structure of the ALFIT of FIG. 6. The ALFIT is composedof ALFITI (ALFIT Information) and ALFI. The ALFITI includes fields of‘ALFI_Ns’ reserved for the number of audio lyric information files,‘AL_I_Ns’ for the number of pieces of audio lyric information, and‘ALFIT_EA’ for an end address of ALFIT.

The ALFI is composed of ALFI_GI (ALFI General Information) and aplurality of ALUI (Audio Lyric Unit Information) search pointers, eachincluding ‘ALU_SA’ for a start address of a lyric unit, ‘ALU_SZ’ forsize of a lyric unit, and ‘L_ATR’ for attribute of a lyric.

The ALU_SA in each ALUI search pointer points to the location of acorresponding ALU (Audio Lyric Unit) in a lyric file named by‘AR_Lyric.ARO’ that is not included in the RTR_AMG. Each ALU in thelyric file ‘AR_Lyric.ARO’ includes a lyric text associated with a singlerecorded song, and the lyric text is divided into several segments‘SG_L_TXT #i’. Each lyric segment also has output-time relatedinformation ‘Time’ and ID code ‘IDCD as described in the aforementionedembodiment.

According to this structure of the RTR_AMG, the ALUI_search pointernumber contained in CI indexes an ALUI search pointer pointing to alyric unit in the file ‘AR_Lyric.ARO’ associated with a recorded AOB,namely a song.

Thus, if a song, namely, an AOB is chosen, the controller 14 reads thenumber written in ALUI_SPRN of CI associated with the selected AOB, andreads an address in ALUI search pointer contained in the field ‘ALFI’indexed by the read number. The location of a lyric unit related withthe selected song is found in the file ‘AR_Lyric.ARO’ by this readaddress.

Then, lyric segments are retrieved sequentially from the first segment‘SG_L_TXT #1’ at the addressed location in the file ‘AR_Lyric.ARO’ bythe reproduced signal processor 12. At this time, the controller 14examines an ID code preceding each lyric segment.

If the ID code is indicative of the type of output-time relatedinformation, the controller 14 conducts continuous and synchronousdisplay of a series of lyric segments together with reproduced audiodata belonging to the selected AOB. In this lyric synchronous displayoperation, a just-displayed lyric segment can be differentiated by coloror font from neighboring lyric segments displayed altogether.

The above-explained lyric data synchronizing method ensuresminutely-synchronous lyric presentation with audio data, e.g., songbeing reproduced in real time from a rewritable recording medium. Thus,a user is able to enjoy a reproduced song better through the lyric textdisplayed in synchronization with the song.

The detailed description of the invention has been directed to certainexemplary embodiments, various modifications of these embodiments, aswell as alternative embodiments, will be suggested to those skilled inthe art. The invention encompasses any modifications or alternativeembodiments that fall within the scope of the claims.

1. A method for displaying text data with playing audio data, the methodbeing performed by a reproducing device and comprising: selecting anaudio data to be played; selecting automatically text data correspondingto the selected audio data; retrieving the selected audio data and textdata corresponding to the selected audio data, the text data beingdivided into a plurality of segmented units of text; decoding theselected audio data; and outputting the decoded audio data through asound output unit of the reproducing device; displaying the segmentedunits of text on a display of the reproducing unit in a synchronousmanner with the outputted sound, by using time information assigned tothe segmented units of text.
 2. The method of claim 1, wherein the audiodata is stored in an audio file and the text data is stored in a textfile that is different from the audio file.
 3. The method of claim 1,wherein each of the segmented units of text corresponds to a specificsection of the audio data.
 4. The method of claim 3, wherein the timeinformation defines the specific section for each of the segmented unitsof text.
 5. The method of claim 3, further comprising selecting aspecific position of the audio data, wherein the outputting comprisesoutputting the decoded audio data from the specific position of theaudio data, and wherein the displaying comprises displaying thesegmented unit text corresponding to the specific position.
 6. Themethod of claim 1, wherein color information is assigned to at least oneof the segmented units of text.
 7. The method of claim 1, wherein elapsetime of a current segmented unit of text equals a start time of a nextsegmented unit of text.
 8. The method of claim 1, wherein the text datais a lyric data of the audio data.
 9. A reproducing device fordisplaying text data with playing audio data, the reproducing devicecomprising: a retrieving unit configured to retrieve audio data and textdata; a decoder configured to decode the audio data; an outputting unitconfigured to output the decoded audio data; a display configured todisplay the text data; and a controller configured to: select the audiodata to be played, select automatically the text data corresponding tothe selected audio data, control the retrieving unit to retrieve theselected audio data and text data corresponding to the selected audiodata, the text data being divided into a plurality of segmented units oftext, and control the display to display the segmented units of text ina synchronous manner with the outputted sound, by using time informationassigned to the segmented units of text.
 10. The reproducing device ofclaim 9, further comprising a storage configured to store the audio datain an audio file, and the text data in a text file that is differentfrom the audio file.
 11. The reproducing device of claim 9, wherein eachof the segmented units of text corresponds to a specific section of theaudio data.
 12. The reproducing device of claim 11, wherein the timeinformation defines the specific section for each of the segmented unitsof text.
 13. The reproducing device of claim 11, wherein the controllerfurther is configured to select a specific position of the audio data,control the outputting unit to output the decoded audio data from thespecific position of the audio data, and control the display to displaythe segmented unit of text corresponding to the specific position. 14.The reproducing device of claim 9, wherein color information is assignedto at least one of the segmented units of text.
 15. The reproducingdevice of claim 9, wherein elapse time of a current segmented unit oftext equals a start time of a next segmented unit of text.
 16. Thereproducing device of claim 9, wherein the text data is a lyric data ofthe audio data.